Scroll bar with video region in a media system

ABSTRACT

An electronic device associated with a remote wand controlling the operations of the electronic device is provided. The wand may include a motion detection component operative to provide an output reflecting the motion of the wand to the electronic device, such that the movements of a cursor displayed by the electronic device may be related to the output of the motion detection component. The wand may also include an input mechanism operative to receive user inputs. Using the input mechanism, the wand may detect a user&#39;s inputs and direct the electronic device to zoom or scroll displayed objects. The electronic device may display a screen saver by which the user may select particular media items for playback while remaining in the screen saver mode. In some embodiments, the electronic device may display video with a scroll bar that includes a preview window of the video.

BACKGROUND OF THE INVENTION

This invention is related to controlling a media system using a remotecontroller.

Some existing media systems may be controlled using a variety ofdifferent input mechanisms. For example, some media systems may becontrolled by a user providing inputs directly on an interface of themedia system (e.g., by pressing buttons incorporated on the mediasystem, or by touching a touch-screen of the media system).

As another example, some media systems may be controlled by a userproviding inputs remotely from the media system (e.g., using a remotecontroller). Some remote controllers may include one or more buttonsthat the user can press to direct the media system to perform one ormore operations. The buttons may be operative to automatically performone or more media system operations, or the buttons may be operative toselect options displayed on-screen. In some embodiments, some remotecontrollers may provide the user inputs associated with the one or morebuttons to the media system using a short-range communications protocol,such as, for example, infrared or radio frequency protocols. To ensurethat the user input is properly received, the user may point the remotecontroller to a receiver of the media system to transmit the user input.

Using these mechanisms to provide inputs to the media system, the usermay provide inputs by pressing buttons with their fingers, or by movingtheir fingers across or on the mechanisms. Although such mechanisms maybe effective, they may also be inefficient and non-intuitive, which maysometimes lead to frustration.

SUMMARY OF THE INVENTION

A media system in which a user may control a media application operationby moving a wand is provided.

The media system may include an electronic device, a screen, and a wand.The user may interact with one or more media applications implemented onthe electronic device using the wand. The wand may include any suitablecomponents for providing instructions to the electronic device. Forexample, the wand may include a motion detection component providingoutputs reflecting the movements of the wand to the electronic device.As another example, the wand may include an input mechanism forreceiving inputs from the user, and operative to provide the receivedinputs to the electronic device. The input mechanism may include anysuitable input mechanism, including for example an input mechanismoperative to detect movements of a user's finger (e.g., a touch screen,touchpad or touch strip).

The electronic device may perform any suitable operation in response toreceiving an output (e.g., generated by a motion detection component) orinput (e.g., received from an input mechanism) from the wand. In someembodiments, the user may control the position of a cursor displayed onthe electronic device screen by moving the wand. In response toreceiving corresponding outputs from the motion detection component, theelectronic device may displace the cursor. In some embodiments, the usermay wish to re-center the cursor. To do so, the user may select acentering option displayed on screen, provide a particular input usingthe input mechanism, or move the wand in a particular manner (e.g.,swing the wand a particular number of times) to direct the motiondetection component to provide an output associated with centering thewand to the electronic device. In some embodiments, the electronicdevice may detect when the wand is moving unintentionally (e.g., due tohand drift or the wand falling) and may automatically center the cursoror ignore initial subsequent wand movements to overcome the hand drift.

When an object is displayed by the electronic device, the user may zoomthe display to access a more detailed view of the object. The user mayprovide the zooming instruction using any suitable approach. In someembodiments, the user may provide a zooming input using the inputmechanism of the wand. For example, the user may slide a finger acrossthe input mechanism to direct the electronic device to zoom thedisplayed object. If several objects are displayed and zoomed, theelectronic device may change the position of the objects on the screento maintain the ordering of the objects.

The user may also scroll several displayed objects. In some embodiments,the user may provide different instructions to scroll the objects indifferent manners. For example, the user may provide a first scrollinginstruction to perform a fine scroll, and a second scrolling instructionto perform a coarse scroll. As another example, the user may provide afirst instruction to scroll displayed objects and a second instructionto scroll through categories of objects. In some embodiments, the usermay provide the first and second instructions by providing differentinputs on the same input mechanism. For example, the user may slide afinger on the input mechanism along a first axis to provide the firstinstruction, and slide a finger on the input mechanism along a secondaxis different than the first to provide the second instruction.

The electronic device may use any suitable approach for receivingtextual inputs from the user. For example, the electronic device maydisplay a keyboard with selectable keys. The user may place a cursorover a key and provide a selection instruction to enter the selected keyin a text window. To access different keys (e.g., from a display ofletters to a display of numbers and characters), the user may provideany suitable instruction to the electronic device. For example, the usermay select a displayed option, or the user may provide an input usingthe input mechanism of the wand (e.g., slide the user's finger acrossthe input mechanism). In some embodiment, the input provided for zoomingobjects and for changing the keys displayed in a keyboard may be thesame or substantially the same.

The user may control the playback of media using any suitable approach.In some embodiments, in response to receiving a user instruction tocontrol the playback of a media item, the electronic device may displaya playback scroll bar that includes an indicator. The user may move theindicator along the scroll bar to change the current playback positionof the media. If the media includes video or images, the indicator mayinclude a video region. As the user moves the indicator, the electronicdevice may display a video frame associated with the current position ofthe indicator in the video region (e.g., and roughly corresponding tothe playback position of the media and of the location of the indicatoron the scroll bar). To reduce the resources used to display images inthe video region, the electronic device may display low resolution videoframes in the video region.

The electronic device may enable or access a screen saver mode inresponse to determining that the user has not provided inputs before aperiod of time lapsed. In some embodiments, the electronic device mayprovide an interactive screen saver. For example, the electronic devicemay display several selectable images, which may move or float acrossthe display. In response to receiving a user selection of an image, theelectronic device may display several listings for media itemsassociated with the selected image. The user may then select a displayedlisting to direct the electronic device to play back the selected mediaitem associated with the selected listing without disabling or exitingthe screen saver mode.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features of the present invention, its nature andvarious advantages will be more apparent upon consideration of thefollowing detailed description, taken in conjunction with theaccompanying drawings in which:

FIG. 1 is a schematic view of an illustrative media system by which auser may control the display of a screen based on the orientation of aremote wand in accordance with one embodiment of the invention;

FIG. 2 is a schematic view of a wand in accordance with one embodimentof the invention;

FIG. 3 is a schematic view of an illustrative display for setting up acursor in accordance with one embodiment of the invention;

FIG. 4 is a flowchart of an illustrative process for centering a cursordisplayed by an electronic device in accordance with one embodiment ofthe invention;

FIGS. 5A-D are illustrative displays of objects as the user zooms inaccordance with one embodiment of the invention;

FIG. 6 is a flowchart of an illustrative process for changing thedisplay of several objects in response to receiving a request to zoom inaccordance with one embodiment of the invention;

FIG. 7 is a flowchart of an illustrative process for scrolling objectsusing a wand coupled to an electronic device in accordance with oneembodiment of the invention;

FIG. 8 is a schematic view of an illustrative screen saver in accordancewith one embodiment of the invention;

FIG. 9 is a schematic view of an illustrative display screen of listingsfor a selected image of a screen saver in accordance with one embodimentof the invention;

FIG. 10 is a schematic view of an illustrative display screen forselecting an off-screen image of a screen saver in accordance with oneembodiment of the invention;

FIG. 11 is a flowchart of an illustrative process for selecting a mediaitem to playback in a screen saver mode in accordance with oneembodiment of the invention;

FIGS. 12A and 12B are schematic views of an illustrative keyboard fordisplay by the electronic device in accordance with one embodiment ofthe invention;

FIGS. 13A and 13B are schematic views of an illustrative keyboard inwhich the cursor movement is restrained in accordance with oneembodiment of the invention;

FIG. 14 is a flowchart of an illustrative process for changing the keysof a virtual keyboard in accordance with one embodiment of theinvention;

FIG. 15 is a schematic display of an illustrative media display inaccordance with one embodiment of the invention. Display 1500 mayinclude media 1510 in a large display;

FIG. 16 is a schematic display of media as the playback position ischanged in accordance with one embodiment of the invention; and

FIG. 17 is a flowchart of an illustrative process for changing theplayback position of media in accordance with one embodiment of theinvention.

DETAILED DESCRIPTION

FIG. 1 is a schematic view of an illustrative media system by which auser may control the display of a screen based on the orientation of aremote wand in accordance with one embodiment of the invention. Otherillustrative media systems used with wands are described in commonlyowned U.S. Provisional Patent Application No. 60/967,835, filed Sep. 7,2007, which is incorporated herein in its entirety.

As shown in FIG. 1, media system 100 may include screen 102, electronicdevice 104 and wand 106. Screen 102 may be any suitable screen ordisplay for displaying media or other content to a user. For example,screen 102 may be a television, a projector, a monitor (e.g., a computermonitor), a media device display (e.g., a media player or video gameconsole display), a communications device display (e.g., a cellulartelephone display), a component coupled with a graphical output device,any combinations thereof, or any other suitable screen.

Electronic device 104 may be coupled to screen 102 by link 110. Link 110may be any suitable wired link, wireless link, or any suitablecombination of such links for providing media and other content fromelectronic device 104 to screen 102 for display. For example, link 110may include a coaxial cable, multi cable, optical fiber, ribbon cable,High-Definition Multimedia Interface (HDMI) cable, Digital VisualInterface (DVI) cable, component video and audio cable, S-video cable,DisplayPort cable, Visual Graphics Array (VGA) cable, Apple DisplayConnector (ADC) cable, USB cable, Firewire cable, or any other suitablecable or wire for coupling electronic device 104 with screen 102. Asanother example, link 110 may include any suitable wireless link forcoupling electronic device 104 with screen 102. The wireless link mayuse any suitable wireless protocol including, for example, cellularsystems (e.g., 0G, 1G, 2G, 3G, or 4G technologies), short-range radiocircuitry (e.g., walkie-talkie type circuitry), infrared (e.g., IrDA),radio frequency (e.g., Dedicated Short Range Communications (DSRC) andRFID), wireless USB, Bluetooth, Ultra-wideband, high frequency systems(e.g., 900 MHz, 2.4 GHz, and 5.6 GHz communication systems), wirelesslocal area network protocols (e.g., WiFi and Hiperlan), or any othersuitable wireless communication protocol.

Electronic device 104 may include any suitable electronic device orcomponent (as, a processor, camera circuitry and a display) forproviding content for display to screen 102. For example, the electronicdevice may be operative to provide one or more output signalrepresenting content, display screens, interactive elements, or anyother suitable object operative to be displayed on screen 102. Uponreceiving an output signal from electronic device 104, screen 102 may beoperative to display the content or objects represented by the outputsignal. The content may include, for example, media (e.g., music, videoand images), guidance screens (e.g., guidance application screens),software displays (e.g., Apple iTunes screens or Adobe Illustratorscreens), prompts for user inputs, or any other suitable content. Insome embodiments, electronic device 104 may be operative to generatecontent or displays that may be provided to screen 102. For example,electronic device 104 may include a desktop computer, a laptop ornotebook computer, a personal media device (e.g., an iPod), a cellulartelephone, a mobile communications device, a pocket-sized personalcomputer (e.g., an iPAQ or a Palm Pilot), a camera, a video recorder, aset-top box, or any other suitable electronic device.

In some embodiments, electronic device 104 may instead or in addition beoperative to transmit content from a host device (not shown) to screen102. For example, electronic device 104 may include a routing device, adevice for streaming content to screen 102, or any other suitabledevice. In some embodiments, electronic device 104 may include an AppleTV sold by Apple Inc. of Cupertino, Calif. Electronic device 104 may beoperative to receive content from the host device in any suitablemanner, including any of the wired or wireless links described above inconnection with link 110. The host device may be any suitable device forproviding content to electronic device 102.

The following example will serve to illustrate an embodiment of thissystem. The host device may be a computer on which media is stored andplayed back using any suitable media application (e.g., iTunes orWindows Media Player). The electronic device may be an Apple TV device.Using a WiFi (e.g., 802.11) communications protocol, the Apple TV devicemay synch with the iTunes software on the host computer to providelistings of content available on a television screen. In response to auser selection of particular media content using a remote controllerassociated with the Apple TV device, the Apple TV device may stream theselected media content from the computer, and provide the streamedcontent to the television screen in high definition over an HDMIconnection. Thus, the user may view the content stored on the hostcomputer on a larger television screen.

To control media system 100, the user may provide instructions toelectronic device 104 using wand 106 coupled to electronic device 104.Wand 106 may include any suitable input device for providing userinstructions to electronic device 104. Wand 106 may be formed into anysuitable shape, including for example an elongated object, a roundobject, a curved object, a rectangular object, or any other suitableshape. Wand 106 may be operative to wirelessly transmit userinstructions to electronic device 104 using any suitable wired orwireless communications protocol, including those described above inconnection with link 110. For example, wand 106 may be operative totransmit instructions using an infrared communications protocol by whichinformation is transmitted from wand 106 to an IR module incorporatedwithin electronic device 104. As another example, wand 106 maycommunicate with electronic device 104 using a Bluetooth or WiFicommunications protocol.

Wand 106 may include one or more input mechanisms (e.g., buttons,switches touch screen or touchpad) for providing user inputs toelectronic device 104. In some embodiments, the input mechanism mayinclude positioning or moving the wand in a specific manner. Forexample, wand 106 may be operative to identify a user input in responseto the user flicking, spinning, rolling or rotating the wand in aparticular direction or around a particular axis. As an illustration, aflick of the wrist may rotate wand 106, causing wand 106 to provide aSELECT or other instruction to electronic device 104. The user may movewand 106 in any direction with respect to the x axis (e.g., movementleft and right on the screen), y axis (e.g., movement up and down on thescreen), and z axis (e.g., movement back and forth from the screen).

Wand 106 may be operative to control a cursor (e.g., a pointer or ahighlight region) displayed on screen 102 to access operations providedby electronic device 104. In some embodiments, the user may control thedisplacement of the cursor by the displacement of wand 106. Media system100 may use any suitable approach for correlating the movement of wand106 with the position of a cursor. For example, wand 106 may include oneor more accelerometers, gyroscopes, or other motion detectioncomponents. Wand 106 may be operative to transmit motion detected by themotion detection component to electronic device 104. For example, wand106 may identify motion in the x-y plane, and transmit the motion toelectronic device 104, which may direct display screen 102 to displace acursor in accordance with the motion of wand 106. Wand 106 may alsoinclude an input mechanism (e.g., a wheel or a touch strip) forproviding inputs in the z direction to electronic device 104 (e.g.,instead of or in addition to identifying motion of wand 106 in the zdirection).

As another example for correlating the movement of wand 106 with theposition of a cursor, any suitable number of IR modules (e.g., 2modules) may be provided in the vicinity of screen 102. The IR modulesmay be operative to emit infrared light for detection by wand 106. Wand106 may be operative to detect the light emitted by the IR modules, anddetermine its position and orientation relative to screen 106 byidentifying its position and orientation relative to the IR modules.Wand 106 may be operative to transmit the position and orientationinformation to electronic device 104, which may convert the position andorientation information into coordinates for the cursor or into anaction to be performed (e.g., zoom in or scroll). In some embodiments,wand 106 may be operative to convert the position and orientationinformation into coordinates for the cursor or an action to beperformed, and transmit the coordinates or action to electronic device104.

In some embodiments, wand 106 may be operative to emit infrared light,and the IR modules may be operative to receive the light emitted by wand106. The IR modules and electronic device 104 may then be operative todetermine, based on the angle at which the light emitted by wand 106 isreceived, and based on the intensity of the received light, the positionof wand 106 relative to the IR modules.

In some embodiments, media system 100 may include a plurality of wands106, for example one for each user. For the sake of clarity, only onewand 106 is shown in FIG. 1. Each wand may be operative to control adifferent cursor, or a different portion of the screen. In someembodiments, each wand may have a different priority such that when morethen one wand is in use, the wand with the highest priority controlsoperations displayed on screen 102. In some embodiments, each wand 106may be operative to provide a unique signal to electronic device 104,thus allowing electronic device 104 to identify the user of media system100, and thus provide a user-specific media experience (e.g., loaduser-specific settings or preferences, or provide user-specific media).

FIG. 2 is a schematic view of a wand in accordance with one embodimentof the invention. Illustrative wand 200 may include communicationscircuitry 204, motion detection component 206 and input mechanism 208.Communications circuitry 204 may be operative to transmit position andorientation information and user inputs from wand 200 to the electronicdevice (e.g., electronic device 104, FIG. 1) using any suitablecommunications protocol, including for example any communicationsprotocol described above in connection with FIG. 1. In some embodiments,communications circuitry 204 may include a processor, memory, a wirelessmodule and an antenna. The processor may be operative to control thewireless module for transmitting data stored or cached in the memory.

Communications circuitry 204 may transmit any suitable data. Forexample, the processor may be operative to transmit motion informationreceived from motion detection component 206 (e.g., accelerationsignals) and user inputs received from input mechanism 208. In someembodiments, the process may temporarily store the data in the memory toorganize or process the relevant data prior to transmission by thewireless module. In some embodiments, the wireless module may transmitdata at predetermined time intervals, for example every 5 ms. Thewireless module may be operative to modulate the data to be transmittedon an appropriate frequency, and may transmit the data to electronicdevice 104. The wireless module may use any suitable communicationsprotocol, including for example Bluetooth.

Motion detection component 206 may be operative to detect the movementof wand 200 as a user moves the wand. Motion detection component 206 mayinclude any suitable element for determining a change in orientation ofthe wand. For example, motion detection component 206 may include one ormore three-axes acceleration sensors that may be operative to detectlinear acceleration in three directions (i.e., the x or left/rightdirection, the y or up/down direction, and the z or forward/backwarddirection). As another example, motion detection component 206 mayinclude one or more two-axis acceleration sensors which may be operativeto detect linear acceleration only along each of x or left/right and yor up/down directions (or any other pair of directions). In someembodiments, the acceleration sensor may include an electrostaticcapacitance (capacitance-coupling) accelerometer that is based onsilicon micro-machined MEMS (Micro Electro Mechanical Systems)technology, a piezoelectric type accelerometer, a piezoresistance typeaccelerometer, or any other suitable accelerometer.

Because in some embodiments motion detection component 206 may includeonly linear acceleration detection devices, motion detection component206 may not be operative to directly detect rotation, rotationalmovement, angular displacement, tilt, position, orientation, motionalong a non-linear (e.g., arcuate) path, or any other non-linearmotions. Using additional processing, however, motion detectioncomponent 206 may be operative to indirectly detect some or all of thesenon-linear motions. For example, by comparing the linear output ofmotion detection component 206 with a gravity vector (i.e., a staticacceleration), motion detection component 206 may be operative tocalculate the tilt of wand 200 with respect to the y-axis.

In some embodiments, motion detection component 206 may include one ormore gyro-sensors or gyroscopes for detecting rotational movement. Forexample, motion detection component 206 may include a rotating orvibrating element. In some embodiments, motion detection component 206used in wand 200 may be operative to detect motion of wand 200 in thex-y plane (e.g., left/right and up/down movements of wand 200) so as tomove a cursor or other element displayed on the screen (e.g., on screen102, FIG. 1). For example, movement of wand 200 in the x-directiondetected by motion detection component 206 may be transmitted to theelectronic device associated with wand 200 to cause a cursor or anotherelement of a display to move in the x-direction. To move a cursor or anelement of the screen in the z-direction (e.g., when advancing into thescreen in 3-D displays, or for zooming a display), wand 206 may includea separate input mechanism (described below).

The electronic device may define distinct acceleration curves,displacement curves, or velocity curves associated with different motiondetection components or different axes for which motion detectioncomponents provide outputs. The different curves (e.g., accelerationcurves) may be used to translate the physical movement of the wand intovirtual movement of the cursor or other objects displayed by theelectronic device to more closely reflect the user's intention whenmoving the wand. For example, different acceleration curves may bedefined to account for the different ranges of motion of the user'shand, wrist or arm in different axes.

Input mechanism 208 may be any suitable mechanism for receiving userinputs. For example, input mechanism 208 may include a button, keypad,dial, a click wheel touchpad, a touch-sensitive input mechanism, atouchpad, or a touch screen. In some embodiments, the input mechanismmay include a multi-touch screen such as that described in U.S. patentapplication Ser. No. 11/038,590, filed Jan. 18, 2005, which isincorporated by reference herein in its entirety. In some embodiments,input mechanism 208 may include a mechanism for providing inputs in thez-direction, and motion detection component 206 may provide inputs formovement in the x and y-directions. For example, input mechanism 208 mayinclude a scroll wheel, touchpad, touch screen, arrow keys, joystick, orother suitable mechanism. In some embodiments, the z-direction mechanismmay be operative to detect finger and thumb swipes in differentdirections. For example, swipes in one direction (e.g., up/down) may beprovided to zoom or scroll the display, and swipes in another direction(e.g., left/right) may be provided to control playback of a track (e.g.,fast forward/rewind or next/last).

In some embodiments, input mechanism 208 may include a mechanism forenabling communications circuitry 204 or motion detection component 206.For example, in response to receiving a user input on the motionenabling mechanism, wand 200 may enable motion detection component 206to detect the user's movements of wand 200, and may directcommunications circuitry 204 to provide outputs of motion detectioncomponent 206 to the electronic device (e.g., unless the user activatescommunications circuitry 204 or motion detection component 206, wand 200may ignore movements of wand 200 and not provide motion information tothe electronic device). This may allow the electronic device to ignoreaccidental movements of the wand and avoid adversely affecting theuser's viewing experience. The motion enabling mechanism may include anysuitable input mechanism, including for example an optical or capacitivesensor operative to detect the position of a user's hand or finger oninput mechanism 208. For example, in response to determining that auser's finger is placed on an optical or capacitive sensor (e.g., theuser's thumb is on the top of wand 200, or the user's hand is on thebody of wand 200), wand 200 may enable communications circuitry 204 ormotion detection component 206.

In some embodiments, input mechanism 208 may include thumbprint orfingerprint sensing components, or any other suitable biometric sensingcomponents, to identify the user currently using wand 200. For example,a thumb or finger printing sensor may be embedded within the motionenabling mechanism or a the z-direction mechanism. In response todetecting a thumbprint or fingerprint, wand 200 or the electronic devicemay compare the detected print with a library of known prints toauthenticate or log-in the user associated with the print. In responseto identifying the user, the electronic device may load content specificto the identified user (e.g., a user profile, or access to the user'srecordings), or provide the user with access to restricted content(e.g., content restricted by parental control options). If wand 200 orthe electronic device does not recognize the thumb or finger print, theelectronic device may load a default or guest profile or may prevent theuser from accessing the Electronic device.

In some embodiments, wand 200 may include an optical component forreceiving and processing infrared light received from one or more IRmodules. In some embodiments, the optical component may include aninfrared filter, a lens, an image pickup element and image processingcircuitry (not shown). The infrared filter may be operative to preventall light waves other than IR light from reaching the lens, which may bepositioned directly behind the infrared filter. The lens may beoperative to pick up the light that passed through the infrared filterand may provide the light to the image pickup element. The image pickupelement may be operative to take an image of the light received from thelens, and may provide the image data to the image processing circuitry.In some embodiments, the image pickup element may include a solid-stateimaging device such as, for example, a CMOS (complimentary metal-oxidesemiconductor) sensor or a CCD (charge-coupled device). The imageprocessing circuitry may be operative to process the image data receivedfrom the image pickup element to identify bright spots corresponding tothe IR modules, and provide position information, orientationinformation, or both to communications circuitry 204.

As described above, the electronic device may display any suitableinterface that can be controlled by wand 200. In some embodiments, theelectronic device may display a cursor that the user may control bymoving wand 200. For example, the cursor may include a light region(e.g., a circular light region) that the user may control by moving wand200. As the user moves wand 200, motion detection component 206 maydetect the wand movement and provide information identifying theparticular movement to the electronic device. Using this information,the electronic device may update the position of the cursor on thedisplay. FIG. 3 is a schematic view of an illustrative display forsetting up a cursor in accordance with one embodiment of the invention.Display 300 may include cursor 302, which the user may control by movinga wand (e.g., wand 200, FIG. 2). The electronic device may indicate theprior movement and current direction of movement of cursor 302 usingtrail 304. Trail 304 may progressively fade to indicate the most recentposition of cursor 302. For example, trail 304 may indicate that cursor302 moved from initial, faded position 306 towards current, intensifiedposition 308. When cursor 302 remains immobile for a particular amountof time (e.g., defined by the trail tracking speed), trail 304 maydissipate and only cursor 302 may be visible.

The electronic device may display any suitable type of cursor. In someembodiments, display 300 may include cursors options 310 for selectingthe type of cursor to display. For example, cursor options 310 mayinclude options for selecting a circle, a white disk, or a grey disk.Other suitable types of cursors may be displayed, including for examplean arrow, a hand, a bar, an icon, or any other suitable cursor. In someembodiments, the electronic device may provide the user with an optionto set the size of the cursor (e.g., the diameter of the circle). Forexample, the electronic device may display a bar with an indicator thatthe user may displace along the bar to define the current size of thecursor.

The electronic device may display cursor 302 at any suitable time. Forexample, the electronic device may always display cursor 302. As anotherexample, the electronic device may display cursor 302 in response todetecting movement of the wand (e.g., in response to receiving an outputfrom motion detection component 206, FIG. 2), or to receiving an inputfrom the wand (e.g., from input mechanism 208, FIG. 2). The electronicdevice may subsequently hide cursor 302 after a particular delay (e.g.,hide cursor 302 after detecting no further movement during a 30 secondperiod). As another example, the electronic device may display cursor302 based on the currently displayed context (e.g. based on theelectronic device content).

In some embodiments, the electronic device may display cursor 302 inresponse to detecting a user's hand on the wand. For example, an opticalor capacitive sensor on the wand may be operative to detect when auser's finger is placed over an input mechanism or over the body of thewand. As another example, a fingerprint sensor may be operative todetect and identify the particular user holding the wand. In response todetecting the user's hand, or in response to determining that a useridentified by a fingerprint sensor is authorized to access theelectronic device, the electronic device may display cursor 302. Theelectronic device may continue to display cursor 302 as long as theuser's hand is detected on the wand, or as long as a motion detectioncomponent or input mechanism of the wand provides user instructions tothe electronic device. In some embodiments, the electronic device mayhide cursor 302 after a particular delay lapses (e.g., 30 seconds afterthe user's hand is no longer detected, or after no outputs or inputs arereceived from the wand.

The user may define attributes of trail 304 using any suitable approach.In some embodiments, the electronic device may display trails option320. In response to receiving a user selection of trails option 320, theelectronic device may display trails length option 322 and trackingspeed option 326. Trails length option 322 may be associated with bar323 on which indicator 324 may slide. As indicator 324 slides along bar323, the length of trail 304 may be adjusted. For example, if indicator324 is placed on the left end of bar 323, trail 304 may be shorter.Conversely, if indicator 324 is placed on the right end of bar 323,trail 304 may be longer. The user may displace indicator 324 along bar323 using any suitable approach, including for example the userselecting indicator 324 using cursor 302 and dragging indicator 324along bar 323.

Similar to trails length option 322, tracking speed option 326 may beassociated with bar 327 on which indicator 328 may slide. As indicator328 slides along bar 327, the speed at which trail 304 dissipates may beadjusted. For example, if indicator 328 is placed on the left end of bar327, trail 304 may dissipate slower. Conversely, if indicator 328 isplaced on the right end of bar 327, trail 304 may dissipate faster. Theuser may displace indicator 328 along bar 327 using any suitableapproach, including for example the user selecting indicator 328 usingcursor 302 and dragging indicator 328 along bar 327.

To assist the user in manipulating cursor 302, the electronic device mayprovide an option for centering cursor 302. For example, if the userinitially was using the wand while sitting down, and subsequently wishesto lie down or stand up and continue to use the wand, the change in theuser's position may cause the wand to move in an unexpected or undesiredmanner. To allow the user to reset the position of the cursor once theuser is in his new position, the user may select centering option 340.For example, the user may navigate cursor 302 to centering option 340and select the option (e.g., by providing an input on the inputmechanism, or moving the wand in a particular manner for the motiondetection component to provide a particular output associated withselecting an option). In response to receiving the selection ofcentering option 340, the electronic device may automatically navigatecursor 302 to the center of display 300. Subsequent movements of thewand detected by the motion detection component may then cause cursor302 to be displaced from the center position of display 300.

Other approaches may be used to center cursor 302. In some embodiments,the user may provide a particular input on the input mechanism of thewand. For example, the user may press a home button or key, or swipe ortap a finger across the input mechanism in a particular manner (e.g.,double tap a touch screen, swipe a finger in a circle on the touchscreen, or lift a finger off the input mechanism for a particular amountof time before returning the finger to the input mechanism). In someembodiments, the user may move the wand in a particular manner to directthe electronic device to center cursor 302. For example, the user mayshake the remote a predetermined number of times, or swing the remote sothat the cursor moves across the screen a predetermined number of times,or move the remote such that the cursor traces a particular pattern(e.g., the user moves the wand so that the cursor moves back and forthacross the screen three times). Once the cursor is centered, theelectronic device may detect the motion of the wand from the newposition of the wand once the cursor was centered instead of the priorwand position prior to centering (e.g., instead of detecting motion fromthe wand pointed towards the screen, the electronic device detectsmotion from the wand pointed towards the ground).

In some embodiments, the user may accidentally or unintentionally movehis hand or let his hand drift as he is holding the wand, causing thecursor to move in an inadvertent manner. The electronic may detect suchdrifting motion using any suitable approach. For example, the electronicdevice may determine that the user's hand is drifting when the cursormoves along an edge of the display (e.g., the user's handunintentionally pivots the wand, causing the cursor to move up along theleft or right edge of the display). As another example, the electronicdevice may detect the change in orientation of the wand using amagnetometer and determine that the rate of change is indicative of handdrift (e.g., the rate of movement is so low that the electronic devicedetermines the user could not be trying to move the cursor, or the rateof movement is so high that the electronic device determines that thewand may have fallen or been dropped).

The electronic device may provide any suitable response to detectinghand drift. For example, the electronic device may automatically centerthe cursor. As another example, the electronic device may display acentering option for the user to re-center the cursor. As still anotherexample, the electronic device may ignore movements of the wand and stopmoving the cursor until the electronic device determines that the user'shand is no longer drifting (e.g., the wand moved in a definite manner,or the user provided an input using an input mechanism). In someembodiments, the electronic device may assist the user in re-centeringthe cursor by requiring the user to physically move the wand a greaterdistance in the direction opposite the detected hand drift such that therelative wand position when the cursor is centered (e.g., relative theuser's position) is the same as the relative position when the cursor iscentered prior to the hand drift (e.g., instead of off-set by the amountof hand drift).

FIG. 4 is a flowchart of an illustrative process for centering a cursordisplayed by an electronic device in accordance with one embodiment ofthe invention. Process 400 may begin at step 402. At step 404, theelectronic device may detect motion of a wand associated with theelectronic device. For example, the electronic device may receive acommunication from communications circuitry of a wand (e.g.,communications circuitry 204 of wand 200, FIG. 2) that identifies themotion of the wand. At step 406, the electronic device may determinewhether the detected motion is associated with centering the cursor. Forexample, the electronic device may determine whether the detected motionmatches an existing motion from a library of motions that is associatedwith centering a displayed cursor. Such motions may include, forexample, shaking the wand a predetermined number of times, moving thewand in a particular pattern, or swinging the wand a particular numberof times. As another example, the electronic device may determinewhether the motion of the wand is associated with the user's handdrifting.

If, at step 406, the electronic device determines that the detectedmotion is not associated with centering the cursor, process 400 may moveto step 408 and end. If, at step 406, the electronic device insteaddetermines that the detected motion is associated with centering thecursor, process 400 may move to step 410. At step 410, the electronicdevice may center the cursor. For example, the electronic device mayignore subsequent motions of the wand and move the cursor to the centerof the display. Process 400 may then move to step 408 and end.

When one or more objects are simultaneously displayed by the electronicdevice, such as for example listings or images, the user may zoom thedisplay of the displayed objects using any suitable approach. In someembodiments, the user may approach or withdraw the wand from the screenor the electronic device to zoom in and out a display. In someembodiments, the user may instead or in addition provide an input usingan z-direction input mechanism. For example, the user may slide a fingerforward and back on a touchpad to zoom in and out. As another example,the user may roll a scroll wheel embedded in the wand. As still anotherexample, the user may pinch several fingers together and spread out thefingers on a touch screen or touchpad. FIGS. 5A-D are illustrativedisplays of objects as the user zooms in accordance with one embodimentof the invention. Display 500 of FIG. 5A may include several objectsdisplayed for the user. For example, display 500 may include severalicons, listings or images that the user may select to view (e.g., 24icons representing media that may be played back in response to a userselection).

The user may select a particular icon around which to zoom using anysuitable approach. In some embodiments, the user may place a cursor overicon 502 and provide a selection input. For example, the user may placea cursor over icon 502 and provide an input using an input mechanism ofthe wand (e.g., a button from input mechanism 208, FIG. 2), or move thewand in a particular manner to provide a selection instruction (e.g.,twist the wand). The electronic device may indicate that icon 502 hasbeen selected using any suitable approach, including for examplechanging the size of icon 502 relative other displayed icons, displayingtitle 504.

In response to receiving an instruction to zoom, the electronic devicemay display a new screen with larger objects. The electronic device mayreduce the number of objects displayed and resize the objects that aredisplayed such that the displayed objects in the new screen are largerthan the objects displayed in the previous screen. Display 510 of FIG.5B may include fewer icons than previously displayed in display 500 ofFIG. 5A. For example, display 510 may include one fewer row of icons,and two fewer columns of icons (e.g., displaying 15 icons). The iconsdisplayed in display 510 may be larger (e.g., zoomed in) than the iconsdisplayed in display 500.

The electronic device may determine which objects to display in a zoomeddisplay using any suitable approach. For example, the electronic devicemay dynamically re-arrange the displayed objects as the user zooms. Insome embodiments, the electronic device may zoom the display such thatthe objects displayed in the center of the display remain visible as thedisplay is zoomed in. In some embodiments, if the user has selected aparticular object (e.g., icon 502), the electronic device may zoom thedisplay such that the selected object remains visible in the zoomeddisplay. Further, the electronic device may maintain the selected objectin generally the same portion of the display as the display is zoomed.In the example of FIGS. 5A and 5B, as display 500 is zoomed to display510, icon 502 becomes icon 512 and remains on the left side of thedisplay. To maintain the ordering of icons from display 500 to display510, icon 506 from display 500, which is the first icon displayed in thelisting, may be removed from display 510. In addition, the iconsfollowing icon 508 in display 500, which are ordered after icon 502, maybe removed from display 510. The electronic device may use any suitablealgorithm for determining which icons to remove, including for exampledetermining how many icons to display in the new display, anddistributing the number of icons to display before and after theselected icon based on the position of the selected icon in the initialdisplay.

In response to an instruction from the user to further zoom thedisplayed objects, the electronic device may further reduce the numberof displayed rows by one, and the number of displayed columns by one(e.g., displaying 8 icons). The electronic device may select whichobjects to remove from the display using any suitable approach discussedabove. For example, display 520 of FIG. 5C may include icon 522, whichmay correspond to icon 512 of display 510. Furthermore, display 520 maynot include any of the icons previously displayed before icon 512 ofdisplay 510, and any icon following icon 514 of display 510 so as tomaintain the ordering of the icons. In response to an additionalinstruction to zoom, the electronic device may still further reduce thenumber of displayed rows by one, and the number of displayed columns byone (e.g., displaying three icons). The electronic device may selectwhich objects to remove from the display using any suitable approachdiscussed above. For example, display 530 of FIG. 5D may include icon532, which may correspond to icon 522 of display 520. Furthermore,display 530 may not include any icon following icon 524 of display 520so as to maintain the ordering of the icons.

FIG. 6 is a flowchart of an illustrative process for changing thedisplay of several objects in response to receiving a request to zoom inaccordance with one embodiment of the invention. Process 600 may beginat step 602. At step 604, the electronic device may display severalobjects. For example, the electronic device may display severalselectable icons for different media (e.g., icons of videos). As anotherexample, the electronic device may display listings for media (e.g., aplaylist for music). The objects may be displayed in any suitable order,including for example in a particular order (e.g., alphabetically). Atstep 606, the electronic device may receive a user selection of aparticular object. For example, the user may direct a cursor to aparticular object using a wand associated with the electronic device,and may provide a selection instruction. At step 608, the electronicdevice may determine whether an instruction to zoom the displayedobjects has been received. For example, the electronic device maydetermine whether a zoom instruction has been provided using an inputmechanism of the wand (e.g., using a z-direction mechanism). As anotherexample, the electronic device may determine whether the distancebetween the wand and the display has changed. If the electronic devicedetermines that no instruction to zoom has been received, process 600may return to step 608 and continue to monitor inputs received from thewand.

If, at step 608, the electronic device instead determines that a zoominstruction has been received, process 600 may move to step 610. At step610, the electronic device may identify the number of objects displayedprior to receiving the zoom instruction. For example, the electronicdevice may determine how many selectable objects are displayed by theelectronic device. At step 612, the electronic device may determine thenew number of objects to display in response to the zoom instruction.For example, the electronic device may determine, based on whether theinstruction was to zoom in or zoom out, and based on the amount to zoom,how many objects to display.

At step 614, the electronic device may determine the change in displayedobjects that are ordered before the selected object in the initialobject display. For example, if the zoom instruction was to zoom in, theelectronic device may determine how many objects initially orderedbefore the selected object to remove from the new object display. Asanother example, if the zoom instruction was to zoom out, the electronicdevice may determine how many objects initially ordered before theselected object to add to the new object display. The electronic devicemay determine how to change the displayed objects using any suitableapproach, including for example selecting how to change the displayedobjects in a manner that maintains the general position of the selectedobject in the display. At step 616, the electronic device may determinethe change in displayed objects that are ordered after the selectedobject in the initial object display. For example, if the zoominstruction was to zoom in, the electronic device may determine how manyobjects initially ordered after the selected object to remove from thenew object display. As another example, if the zoom instruction was tozoom out, the electronic device may determine how many objects initiallyordered after the selected object to add to the new object display. Theelectronic device may determine how to change the displayed objectsusing any suitable approach, including for example selecting how tochange the displayed objects in a manner that maintains the generalposition of the selected object in the display. At step 618, theelectronic device may display the objects with the changes identified atsteps 614 and 616. For example, the electronic device may display azoomed-in or zoomed-out display of objects that includes fewer or moreobjects, as determined by steps 614 and 616. Process 600 may then end atstep 620.

In some embodiments, the user may change the order of several objectsdisplayed by the electronic device. For example, returning to display500 of FIG. 5A, the user may change the order of displayed icons 502using any suitable approach. For example, the user may select aparticular icon by placing a cursor over the icon, selecting the iconand dragging the cursor to a new position on the display. In response toreceiving the user instruction to drag a selected icon, the electronicdevice may move the selected icon to follow the movement of the cursorwhile displacing the remaining, unselected icons of the display (e.g.,creating a new position for the icon in the display). Once the user hasidentified a new position for the icon, the user may provide aninstruction to release the selected icon to place the icon in its newposition.

When fewer than all of the available objects are simultaneouslydisplayed (e.g., once the user has begun to zoom in a display of severalimages, as shown in FIGS. 5A-D), the user may scroll the display of theobjects. For example, from display 520, the user may scroll up or downto change the displayed icons (e.g., to include icons ordered before orafter the first and last icons of display 520). The user may provide aninstruction to scroll objects using any suitable approach. In someembodiments, the user may move the wand in a particular direction (e.g.,towards an edge of the display) to scroll in the direction in which thewand is pointed. The speed at which the wand is moved, and theparticular position on the screen may be used to determine the speed atwhich to scroll, and the amount to scroll.

In some embodiments, the user may provide an instruction to scroll byproviding an input using an input mechanism of the wand. For example,the input mechanism may include a touch screen or touchpad with whichthe wand may track movements of the user's finger. As the user moves hisfinger in a particular direction, the electronic device may scroll thedisplayed objects in the tracked direction. If there are a limitednumber of directions in which the objects may be scrolled, theelectronic device may extrapolate, from the general direction of thetracked movement of the user's finger, the direction in which to scrollthe displayed objects (e.g., if the tracked movement detects movementfrom the bottom of the wand towards the top of the wand, scroll up thedisplayed objects).

The electronic device may scroll the displayed objects at any suitablespeed. In some embodiments, the scrolling speed may be related to thespeed at which the user's finger moves across the input mechanism. Forexample, if the user moves his finger rapidly, the electronic device mayscroll rapidly, and conversely, if the user moves his finger slowly, theelectronic device may scroll slowly. The electronic device may stopscrolling a display at any suitable time. For example, the electronicdevice may stop scrolling as soon as the user lifts his finger from theinput mechanism. As another example, if the user flicks the inputmechanism to scroll the displayed objects, the electronic device mayprogressively slow the scrolled objects before coming to a stop. Inaddition or instead of progressively slowing down, the electronic devicemay stop the scrolling of objects in response to determining that theuser has tapped to input mechanism or placed his finger on the inputmechanism.

In some embodiments, the electronic device may perform differentscrolling operations based on the direction of motion tracked by thewand. For example, the electronic device may perform a differentscrolling function based on the particular axis in which the wanddetected motion of a user's finger. The electronic device may beoperative to detect motion in any suitable number of axes to providedifferent types of scrolling associated with each axis. The type ofscrolling implemented in response to the detected motion may depend onthe particular objects or menu displayed by the electronic device. Forexample, the electronic device may display a menu having severalcategories of objects. In response to a user selection of a particularcategory, listings of objects related to the selected category may bedisplayed. When the wand detects motion of a user's finger on an inputmechanism in a first axis (e.g., up/down motion), the electronic devicemay scroll through the displayed objects associated with the selectedcategory. When the wand instead detects motion of a user's finger in asecond axis (e.g., left/right motion), the electronic device may scrollthrough the available categories (e.g. and replace the displayedobjects).

As another example, the electronic device may initiate coarse scrollingof objects in response to detecting motion along a first axis (e.g.,left/right motion), and fine scrolling of objects in response todetecting motion along a second axis (e.g., up/down motion). As anotherexample, the device may initiate scrolling in response to motion along afirst axis, and paging or jumping to chapter markers in response tomotion along a second axis. If the wand detects motion in both axessimultaneously, the electronic device may simultaneously scroll both thedisplayed objects and categories in an amount related to the amount ofmotion in each axis, or may instead identify the axis in which moremotion was provided, and disregard the other axis. In some embodiments,one or more scrolling modes may include displaying a selectable listingof tabs that the user may select to jump to a particular section in thedisplayed objects. For example, the electronic device may display analphabet, chapter numbers, or numbers (e.g., decades) that the user mayselect to jump to a particular object (e.g., display a vertical alphabetalong the side of the display).

In some embodiments, the user may control the playback of media myproviding different inputs along different axes of the same inputmechanism. For example, inputs provided in a first axis (e.g., up/down)may direct the electronic device to fast-forward or rewind the currentlyplayed back media item. Inputs provided in a second axis (e.g.,left/right) may direct the electronic device to skip to the previous ornext media item in the list (e.g., in the playlist or album). In someembodiments, the user may simultaneously provide an input along aparticular axis along with a second input (e.g., hold one fingersubstantially immobile on the touch screen or touchpad while swipinganother finger, or pressing a button while swiping another finger) tocontrol another media playback feature or operation (e.g., volume).

FIG. 7 is a flowchart of an illustrative process for scrolling objectsusing a wand coupled to an electronic device in accordance with oneembodiment of the invention. Process 700 may begin at step 702. At step704, the electronic device may detect motion on an input mechanism ofthe wand. For example, the wand may detect motion of a user's fingeracross input mechanism 208 of wand 200 (FIG. 2) and provide anindication of the motion to the electronic device. At step 706, theelectronic device may identify the axis of the detected motion. Forexample, the electronic device may compare the direction of the motiondetected at step 704 with one or more known axes of motion associatedwith the input mechanism. The input mechanism may have any suitableknown axes of motion, including for example up/down and left/right. Insome embodiments, the electronic device may identify several axesassociated with the detected motion. If several axes are detected, theelectronic device may identify the one or more of the more prominentaxes and ignore the remaining axes, or may instead or in additiondetermine of the position of detected motion associated with each of theidentified several axes.

At step 708, the electronic device may select a particular axis ofmotion associated with the input mechanism. For example, the electronicdevice may identify a library of axes associated with the inputmechanism, and select a first axis from the library. At step 710, theelectronic device may determine whether the axis identified at step 706is the same as the axis selected at step 708. If the electronic deviceidentified several axes at step 706, the electronic device may determinewhether the axis selected at step 708 is the same as at least one of theidentified axes. If the electronic device determines that the identifiedaxis is not the same as the selected axis, process 700 may move to step712. At step 712, the electronic device may select another axis ofmotion associated with the input mechanism. For example, the electronicdevice may select the next axis in the library of axes associated withthe input mechanism. Process 700 may then return to step 710 and comparethe newly selected axis with the axis identified at step 706.

If, at step 710, the electronic device instead determines that theidentified axis is the same as the selected axis, process 700 may moveto step 714. At step 714, the electronic device may scroll the displayedobjects using the scrolling function associated with the selected axis.For example, the electronic device may initiate fine scrolling, coarsescrolling paging, jumping to chapter markers in response to determiningthe scrolling function associated with the selected axis. If severalaxes of motion were identified at step 706, process 700 may move to step712 to select another axis of motion associated with the inputmechanism. If only one axis was identified, or if the scrolling functionassociated with all of the identified axes have been identified, process700 may then end at step 716.

When the user of the electronic device ceases providing input over aparticular amount of time, the electronic device may enable a screensaver mode. In some embodiments, the screen saver mode may beinteractive without causing the electronic device to exit the screensaver mode and activate other electronic device processes. Theelectronic device may include any suitable screen saver. For example,the screen saver may include selectable icons representing differentmedia objects. FIG. 8 is a schematic view of an illustrative screensaver in accordance with one embodiment of the invention. Display 800may include several images 810 representing different media objects ormedia items displayed on a blank or background screen (e.g., on awallpaper or colored background). For example, images 810 may includealbum art associated with different musical pieces available to theelectronic device. The electronic device may select which images 810 todisplay using any suitable approach. In some embodiments, the electronicdevice may first determine a subset of media items for which to displayimages as part of the screen saver. The electronic device may select thesubset based on any suitable criteria. In some embodiments, theelectronic device may select, automatically or in response to a userinstruction, a subset of media items accessible to the electronic devicefrom a library (e.g., a remotely or locally stored music libraryaccessed using iTunes). For example, the user may select particularmedia items to use in a screen saver (e.g., a screen saver musicplaylist). As another example, the electronic device may automaticallypick the user's highest rated media items, favorite media items,recommended media items, recently acquired media items (e.g., recentlypurchased using iTunes), recently listened to media items, not recentlylistened to media items, the media items for which an image isavailable, or any other subset of media items. In some embodiments, theelectronic device may select all of the media items available to theuser, or may limit the number of media items selected for the screensaver (e.g., to allow the user to view all of the images displayed aspart of the screen saver).

Once the electronic device has selected the subset of media items, theelectronic device may identify images associated with each selectedmedia item. The electronic device may identify the images using anysuitable approach. For example, the electronic device may identifyimages associated with selected media items in a media applicationlibrary (e.g., an iTunes library). If no particular image is associatedwith a selected media item, the electronic device may select a defaultimage (e.g., an icon), prompt the user to select an image, or deselectthe media item. In some embodiments, several media items may beassociated with a particular image. For example, several tracks of asame album, or by a same artist may be associated with an imagerepresenting the album or the artist.

The electronic device may display images 810 using any suitableapproach. In some embodiments, the electronic device may display images810 in different sizes and in different areas of the display. Someimages 810 may be overlaid over other images 810. The electronic devicemay animate one or more of images 810 to dynamically change the images810 displayed at a particular time. For example, the electronic devicemay move or float images 810 in a vertical direction (e.g., up or down),in a horizontal direction (e.g., left and right), or in an arbitrarydirection (e.g., an angled orientation). The electronic device may moveeach image 810 at a particular speed, which may differ for each image(e.g., some images move rapidly, and others more slowly). The electronicdevice may use any suitable approach for displaying images that reach aborder of the display. For example, the electronic device may treat theborder as a hard edge off which images 810 may bounce or deflect. Asanother example, the electronic device may allow images 810 to disappearpast the edge of display 800, and later re-appear at the same or anotheredge of the display (e.g., disappear at the top, and re-appear at thebottom). The position on the display at which an image may re-appear mayor may not correspond to the position on the display at which the imagedisappeared (e.g., the image may re-appear along the same line or axisas the image initially disappeared).

To provide an illusion of depth, the electronic device may assign imagesto different, overlaid tracks. For example, the electronic device maydisplay a first image 812 in a rear track, and a second image 814 in aforward track such that, as images 812 and 814 move, image 814 may bedisplayed on top of image 812. The electronic device may display anysuitable number of tracks, including for example one track for eachdisplayed image, or a reduced number of tracks (e.g., 1 to 10 tracks).In some embodiments, the user may select how many tracks to use fordisplaying images 810.

In some embodiments, the user may enable a flashlight mode to view aparticular image 810. For example, in response to receiving a particularuser input from an input mechanism of the wand (e.g., the user placing afinger on a button of the wand, or swiping a finger on an inputmechanism in a particular manner), the electronic device may illuminatea section of the screen that is adjacent to the position of the cursor(e.g., surrounding the cursor). The electronic device may change theillumination of the displayed images as the user moves the wand and theilluminated portion of the screen changes to follow the movement of thecursor.

The user may select a particular image 810 while remaining in the screensaver mode using any suitable approach. For example, the user may move acursor over a particular image (e.g., by moving a wand coupled to theelectronic device to control the placement of the cursor) to select animage. In some embodiments, the user may in addition provide a selectioninput (e.g., provide an input using an input mechanism, or move the wandin a particular manner). In response to receiving a user selection of aparticular image, the electronic device may indicate that the particularimage has been selected using any suitable approach. In someembodiments, the electronic device may indicate that an image has beenselected by pausing the movement of the selected image. For example, inresponse to receiving a user selection of image 820, the electronicdevice may stop the movement of image 820 while continuing to move theremaining images 810 displayed by the screen saver. In some embodiments,the electronic device may bring the selected image to the front of thedisplay, change the illumination of the image (e.g., as if theilluminated portion of the flashlight mode were on the selected image),change the size of the image, or modify the image in any other suitablemanner to differentiate the selected image from the remaining images.For example, image 820 may be illuminated (e.g., as if a flashlight ispointed at image 820). As another example, image 820 may be displayed infront of the other images 810 displayed as part of the screen saver.

The user may access a listing of media items associated with a selectedimage using any suitable approach. In some embodiments, after selectingan image (e.g., image 820), for example by placing a cursor over theimage, the user may provide an input (e.g., using an input mechanism) toview media item listings for the selected image. FIG. 9 is a schematicview of an illustrative display screen of listings for a selected imageof a screen saver in accordance with one embodiment of the invention.Display 900 may include several images 910, which may continue to movewhile a particular image has been selected. For example, images 910 maybe displaced with respect to images 810 of FIG. 8 (e.g., images 910 havemoved up relative to images 810).

In response to receiving the user instruction to display media itemlistings, the electronic device may display listings display 930. Forexample, the electronic device may replace the display of the selectedimage (e.g., image 820, FIG. 8) with listings display 930. Theelectronic device may display listings display 930 using any suitableapproach. For example, the electronic device may display a pop-up windowhaving several listings (e.g., a pop-up window in the center of thescreen). As another example, the electronic device may display a newdisplay window having listings. As still another example, the electronicdevice may display a media application display that includes listingsfor media items.

Display 930 may include any suitable information for identifying mediaitems associated with the selected image. For example, display 930 mayinclude image 920, which may be a reduced-size representation of theselected image (e.g., image 820). Display 930 may include title 932 andlistings 934 of media items associated with title 932. For example,title 932 may be the title of an album, compilation or playlist, andlistings 934 may include information identifying music in the album,compilation or playlist (e.g., artist and song names). The user mayselect a particular listing by placing highlight region 936 over thelisting using cursor 938, and providing a selection instruction. Display930 may include any suitable number of listings 934. For example,display 930 may include up to a limited number of listings (e.g., up to10 listings). If more media items than the limited number are associatedwith the selected image, the electronic device may allow the user toscroll listings 934. For example, the user may scroll listings 934 byproviding an input using an input mechanism of the wand (e.g., swiping afinger across a touch screen or touchpad embedded in the wand). Asanother example, the user may move cursor 938 to the edges of display930 to scroll listings 934 (e.g., move cursor 938 to the upper edge ofdisplay 930 to scroll up, or move cursor 938 to the lower edge ofdisplay 930 to scroll down). To assist the user in scrolling display930, the electronic device may prevent cursor 938 from being movedbeyond the boundaries of display 930 (e.g., prevent the user fromplacing cursor 938 on the top edge of display 900 in an attempt toscroll listings 934). To select a different image, the user may firstdirect the electronic device to hide display 930 (e.g., and displayselected image 920 with images 910).

In some embodiments, the user may select title 932 by placing highlightregion 936 over title 932. In response to receiving a user selection oftitle 932, the electronic device may provide the user with other mediaitems or groupings of media items (e.g., albums, playlists orcompilations) related to the selected title 932. For example, theelectronic device may identify related media items using a mediaapplication implemented on the electronic device. The electronic devicemay use any suitable criteria to identify other media items to displayin response to receiving a selection of title 932. For example, theelectronic device may identify media items that share an attribute(e.g., genre, artist, or ranking) with one or more media itemsassociated with the selected title (e.g., media items of listings 934).As another example, the electronic device may identify media itemsidentified as being of interest to the user based on the user'spreferences (e.g., as determined by monitoring the user's interactions,or by receiving an indication of preferences from the user).

In response to a user selection of a particular listing (e.g., inresponse to receiving a user input selecting a highlighted listing), theelectronic device may play back the media item of the selected listing,for example without interrupting or disabling the screen saver. Forexample, the electronic device may retrieve from memory the selectedmedia item, and direct an audio output mechanism to provide an audiooutput for the media item. As another example, the electronic device maydisplay a video clip or video associated with the selected listing ondisplay 900. The displayed media may move (e.g., with images 910) or mayremain immobile in any suitable section of the screen). Once the userhas a selected a particular media item, the electronic device may hidedisplay 930, and continue to display images 910 (including, for example,the previously selected image 920). Alternatively, the electronic devicemay maintain display 930 until a user instruction to hide display 930 isreceived (e.g., a user instruction to hide display 930, or receiving auser selection from an input mechanism while the cursor is outside ofdisplay 930), or until a particular amount of time lapses (e.g., 1minute lapses).

In some embodiments, the user may select an image that is partially offthe display. FIG. 10 is a schematic view of an illustrative displayscreen for selecting an off-screen image of a screen saver in accordancewith one embodiment of the invention. Display 1000 may include severalimages 1010 which may move as part of the screen saver. When the userselects an image 1010 that is displayed partially off the edge of screen1000, for example by placing a cursor over a portion of the image, theelectronic device may scroll the image on display 1000 and indicate thatthe image is selected using an approach described above. For example, inFIG. 10, in response to the user placing a cursor on image 1020, theelectronic device may move the entire image 1020 onto the front ofdisplay 1000, pause the movement of image 1020 (which may be onlypartially displayed on screen 1000), illuminate image 1010 (e.g., as ifa flashlight were pointed at image 1010), combinations thereof, orperform any other suitable operation.

The user may exit or disable the screen saver mode using any suitableapproach. For example, while displaying several images (e.g., images 810in FIG. 8), the user may provide a selection instruction (e.g., using aninput mechanism embedded in the wand) on a portion of the display thatdoes not include any images. As another example, the user may provide anEXIT, BACK or HOME instruction using an input mechanism of the wand(e.g., press an EXIT or HOME key on the wand). The electronic device maycontinue to play back a selected media item in response to receiving arequest to exit the screen saver mode, or may instead pause or stop theplayed back media.

FIG. 11 is a flowchart of an illustrative process for selecting a mediaitem to playback in a screen saver mode in accordance with oneembodiment of the invention. Process 1100 may begin at step 1102. Atstep 1104, the electronic device may enter or enable a screen savermode. For example, the electronic device may determine that the user hasnot provided any inputs for a particular amount of time, and enter ascreen saver mode. As another example, the electronic device may receivea user request to enter the screen saver mode. At step 1106, theelectronic device may determine whether an instruction to exit thescreen saver mode has been received. For example, the electronic devicemay determine whether the user has provided an instruction to exit thescreen saver mode (e.g., by selecting a particular portion of thedisplay, or by selecting a HOME or BACK key on a wand associated withthe electronic device). If the electronic device determines that theuser provided an instruction to exit the screen saver mode, process 1100may exit the screen saver mode and end at step 1108.

If, at step 1106, the electronic device instead determines that the userhas not provided an instruction to exit the screen saver mode, process1100 may move to step 1110. At step 1110, the electronic device maydisplay several selectable images as part of the screen saver. Eachselectable image may be associated with one or more media items (e.g.,video or audio media items) selected by the electronic device using anysuitable criteria (e.g., user-identified, most popular, recommendedmedia items, recently played back, or favorite media items). In someembodiments, one or more of the selectable images may move on thedisplay (e.g., at different speeds, and along different axes ordirections). At step 1112, the electronic device may detect the currentposition of a cursor controlled by the user. For example, the electronicdevice may detect the movement of a wand associated with the electronicdevice, and may detect the current position of a cursor that iscontrolled by the movement of the wand. At step 1114, the electronicdevice may determine whether the cursor is displayed on an image. Forexample, the electronic device may determine whether the currentposition of the cursor is on one of the displayed images. If theelectronic device determines that the cursor is not displayed on animage, process 1100 may return to step 1112 and continue to detect thecurrent position of the cursor.

If, at step 1114, the electronic device instead determines that thecursor is located on an image, process 1100 may move to step 1116. Atstep 1116, the electronic device may receive a user request to viewmedia item listings associated with the image on which the cursor islocated. For example, in response to determining that the cursor is onan image (e.g., determining that an image has been selected), theelectronic device may stop moving the image, and bring the image to thefront of the display for viewing by the user. The user may subsequentlyprovide an input, for example using an input mechanism of the wand, toview listings of the media items associated with the image. In responseto receiving the user request to view the listings, the electronicdevice may display the listings of media items (e.g., instead of or inaddition to the selected image).

At step 1118, the electronic device may receive a user selection of aparticular listing. For example, the electronic device may determinethat the user has placed a highlight region over a particular listingusing the cursor, and has provided a selection instruction. At step1120, the electronic device may play back the media item associated withthe selected listing. For example, the electronic device may output theaudio for a selected song or other musical piece. As another example,the electronic device may display a video window with the video clip orprogram for a selected video. Process 1100 may then return to step 1106and determine whether the user has provided an instruction to exit thescreen saver mode.

In some embodiments, the electronic device may enable the user toprovide textual inputs. For example, the electronic device may provideapplications for which the user may provide textual inputs. Suchapplications may include, for example, a word processing application, aweb browser, an address book application, or any other suitableapplication in which a user may provide a textual input. In response toreceiving a user request to provide a textual input (e.g., in responseto the user placing the cursor on a text-entry portion of the display),the electronic device may display a virtual keyboard. FIGS. 12A and 12Bare schematic views of an illustrative keyboard for display by theelectronic device in accordance with one embodiment of the invention.Display 1200 may include text window 1210 and keyboard 1220. Text window1210 may include text 1212 typed by the user, and marker 1214 indicatingthe current text input position of the electronic device. In someembodiments, marker 1214 may blink or be animated to indicate thecurrent text input position. The user may move marker 1214 using anysuitable approach, including for example by selecting marker 1214 usingcursor 1222 and dragging marker 1214 across text 1212.

The user may select a particular character to enter in text window 1210by placing cursor 1222 over a key 1224 and pending a selection input.The electronic device may indicate that a particular key is highlighted(e.g., that the cursor is placed over the particular key) using anysuitable approach, including for example changing the color of the key(e.g., in FIG. 12A, the ‘T’ key is darker than the other keys ofkeyboard 1220). The electronic device may indicate that the user hasselected a key to display the associated character in text window 1210using any suitable approach. In some embodiments, the electronic devicemay change the display of the selected key (e.g., change the color orillumination of key 1224), or display a pop-up window with the key(e.g., a window with a larger key).

Keyboard 1220 may include any suitable character. In some embodiments,keyboard 1220 may include letters that the user may select. To accessother characters, the user may select any suitable key (e.g., characterkey 1230) to display a different keyboard configuration. FIG. 12B is aschematic view of an illustrative keyboard displaying selectablecharacters in accordance with one embodiment of the invention. Display1250 may include text window 1260 and keyboard 1270. In response toreceiving a user selection of a character key (e.g., character key 1230,FIG. 12A), the electronic device may change the keys displayed inkeyboard 1270 to display characters other than letters (e.g., numbersand punctuation marks).

The electronic device may change the keys displayed in the keyboardusing any suitable approach. In some embodiments, the keyboard maychange in response to receiving a user selection of a particular key(e.g., character key 1230), or in response to a user providing aparticular input with the input mechanism (e.g., pressing a SHIFT orKEYBOARD key of the input mechanism). In some embodiments, theelectronic device may change the displayed keyboard in response toreceiving an input from a z-direction mechanism of the electronicdevice. For example, in response to detecting a user swiping a fingeracross a touchpad (e.g., in an up/down motion) or rolling ascroll-wheel, the electronic device may change the keys displayed in thekeyboard. The input provided on the input mechanism may include anysuitable type of input, including for example an input associated withproviding a zoom instruction (e.g., zoom in to display numbers andpunctuation marks, zoom out to display letters).

In some embodiments, the keys displayed in a keyboard may change basedon the context of the application. For example, the electronic devicemay display a keyboard with keys that do not include a space bar in aweb browser or email address application. As another example, theelectronic device may display a keyboard that includes a “.com” key in aweb browser application. As still another example, the electronic devicemay display a keyboard that includes number keys or a keypad in atelephone or text message application.

In some embodiments, one or more applications of the electronic devicemay include predictive spelling capabilities. The electronic device mayprovide predictive spelling functionality using any suitable approach.In some embodiments, the electronic device may predict the desired keyby matching the previously selected keys with a database of commonwords, or may change previously selected characters to match a word inthe database. As another example, the electronic device may predict oridentify the key a user intended to select based on the dwell-time overa particular key, the number of times the user previously selected thekey, the nature of the key (e.g., vowel or consonant), the movement orspeed of the cursor as it moves across the keyboard, any combination ofthese, or any other suitable approach.

To assist the user in selecting keys displayed on the keyboard, theelectronic device may selectively restrain the movement of the cursor tothe keyboard portion of the display. FIGS. 13A and 13B are schematicviews of an illustrative keyboard in which the cursor movement isrestrained in accordance with one embodiment of the invention. Display1300 may include text portion 1310 and keyboard 1320, which may bedelimited by upper bound 1322 and lower bound 1324. The movement ofcursor 1330 may be constrained between upper bound 1322 and lower bound1324 such that when the user moves cursor 1330 towards the top or bottomof display 1300, the cursor highlights a key along the top or bottomedge of keyboard 1320, thus reducing overshoot issues.

The electronic device may allow the cursor to move beyond keyboard 1320using any suitable approach. For example, the user may provide an inputin addition to moving the wand (e.g., an input using an input mechanism)for extending beyond the keyboard. As another example, the user mayselect an on-screen icon for moving beyond the keyboard (e.g., an optionfor disabling overshoot control). As still another example, theelectronic device may determine whether the user intended to move thecursor beyond the keyboard area or simply overshot a selected key byanalyzing the direction and speed of the cursor movement (e.g., themotion vector of the cursor).

In some embodiments, the wand may provide tactile or other feedback tothe user of the electronic device. The wand may provide tacticalfeedback using any suitable approach. For example, the wand may vibratein response to the rotation of a motor coupled to an unbalanced cam, orto the activation of any other vibrating mechanism. As another example,one or more lights of the wand may be illuminated. The electronic devicemay direct the wand to provide tactile feedback in any suitable contextor configuration. For example, the wand may provide feedback to indicateto the user that a selection instruction was received. As anotherexample, the wand may provide feedback to indicate that the cursorreached a boundary (e.g., was moved into upper bound 1332 or lower bound1334), or that the wand is drifting (e.g., the user let his hand drift).As still another example, the wand may provide feedback to indicate thata particular option was selected (e.g., a particular icon or image wasselected).

FIG. 14 is a flowchart of an illustrative process for changing the keysof a virtual keyboard in accordance with one embodiment of theinvention. Process 1400 may begin at step 1402. At step 1404, theelectronic device may display a keyboard with a first set of keys. Forexample, the electronic device may display a virtual keyboard with keysrepresenting letters. As another example, the electronic device maydisplay a virtual keyboard with keys representing numbers andpunctuation marks. At step 1406, the electronic device may determinewhether an input was received to change the keyboard on an inputmechanism of a wand associated with the electronic device. For example,the electronic device may determine whether the wand provided an inputto change the characters displayed in the virtual keyboard. The receivedinput may include any suitable type of input. For example, the input mayinclude a finger swipe across a touch screen or touchpad, or a press ofa button or key on the wand. As another example, the input may includerolling a scroll wheel. As still another example, the input may includea user selection of an on-screen display (e.g., a character key). If theelectronic device determines that the wand received an input to changethe keyboard on an input mechanism of the wand, process 1400 may move tostep 1408.

At step 1408, the electronic device may replace the displayed keys witha second set of keys. For example, the electronic device may replace afirst set of keys associated with letters with a second set of keysassociated with numbers and punctuation marks. Process 1400 may thenmove to step 1410. If, at step 1406, the electronic device insteaddetermines that the wand has not received an input on an input to changethe keyboard mechanism of the wand, process 1400 may move to step 1410.

At step 1410, the electronic device may displace a cursor on the screento follow the movement of the wand associated with the electronicdevice. For example, the electronic device may receive an output of oneor more motion detection components and determine the amount anddirection by which to move the cursor based on the received output suchthat the movement of the cursor matches the movement of the wand (e.g.,as detected by the motion sensing component output). At step 1412, theelectronic device may determine whether the user has provided aselection instruction. For example, the electronic device may determinewhether the wand received a selection instruction from the user (e.g.,whether the user moved the wand in a particular manner, or whether theuser provided an input using an input mechanism). If the electronicdevice determines that the user has provided a selection instruction,process 1400 may move to step 1414. At step 1414, the electronic devicemay display a character associated with a selected key in a text portionof the display. For example, in response to determining that the userprovided a selection instruction while placing the cursor over aparticular key of the keyboard, the electronic device may display thecharacter associated with the particular key. Process 1400 may thenreturn to step 1406 to determine whether the user provided an input onan input mechanism.

If, as step 1412, the electronic device instead determines that the userhas not provided a selection instruction, process 1400 may move to step1416. At step 1416, the electronic device may determine whether thecursor abuts an edge of the keyboard. For example, the electronic devicemay identify the borders or bounds of the keyboard, and determinewhether the cursor abuts one or more of the identified borders orbounds. If the electronic device determines that the cursor abuts anedge of the keyboard, process 1400 may move to step 1418. At step 1418,the electronic device may provide tactile feedback of the cursorposition. For example, the wand associated with the electronic devicemay vibrate in response to determining that the user moved the cursoragainst an edge of the keyboard. Process 1400 may then return to step1406 to determine whether the user provided an input to change thekeyboard on an input mechanism.

If, at step 1416, the electronic device instead determines that thecursor does not abut an edge of the keyboard, process 1400 may move tostep 1420. At step 1420, the electronic device may determine whether thean instruction to exit the keyboard mode was provided. For example, theelectronic device may determine whether the user provided an input usingthe input mechanism of the wand to exit the keyboard mode (e.g., theuser provided an EXIT instruction, or selected a portion of the screenthat is not associated with text entry). If the electronic devicedetermines that no instruction to exit the keyboard mode was provided,process 1400 may return to step 1406 to determine whether the userprovided an input on an input mechanism. If, at step 1420, theelectronic device instead determines that an instruction to exit thekeyboard mode was provided, process 1400 may move to step 1422 and end.

The electronic device may display any suitable media on the display. Forexample, the electronic device may display video, including for examplemovies, video clips, music videos, or any other combination of image andaudio. FIG. 15 is a schematic display of an illustrative media displayin accordance with one embodiment of the invention. Display 1500 mayinclude media 1510 in a large display. For example, media 1510 may bedisplayed in full screen or in substantially full screen. The user maycontrol the playback of media 1510 using any suitable approach. In someembodiments, the user may direct the electronic device to display scrollbar 1520 representative of the displayed media playback position. Theelectronic device may display scroll bar 1520 in response to anysuitable user instruction. For example, the electronic device maydisplay scroll bar 1520 in response to a user input on an inputmechanism of the wand (e.g., a click of a button), a particular wandmovement (e.g., a wand movement for pausing the media), or any othersuitable wand input. As another example, the electronic device maydisplay scroll bar 1520 in response to receiving a user instruction tostop or pause the media (e.g., if the wand includes a single button, inresponse to receiving a click of the single button).

The user may select a particular playback position for the media bymoving indicator 1524 to a particular position on scroll bar 1520. Forexample, if the user wishes to view a portion of the media that isbehind of the current playback position, the user may select indicator1524 and slide indicator 1524 to the desired playback position to theleft (e.g., behind) of the current playback position (e.g., identifiedby the limited position of indicator 1524). FIG. 16 is a schematicdisplay of media as the playback position is changed in accordance withone embodiment of the invention. Display 1600 may include media 1610 ina large display. In some embodiments, media 1610 may be the same asmedia 1510, but at a different playback position. Display 1600 mayinclude scroll bar 1620, which may identify the current playbackposition using indicator 1624.

The user may direct the electronic device to displace indicator 1524 (or1624) using any suitable approach. For example, once the user has placedcursor 1526 (or 1626) over the indicator, the user may provide aselection input (e.g., press and release a button, or swipe a fingeracross a touch screen or touchpad) to hold the indicator (e.g., andrelease with a second selection input or a release input). As the usermoves the wand to direct the electronic device to displace cursor 1526(or 1626), the electronic device may displace indicator 1524 (or 1624).As another example, the user may provide and hold a selection input(e.g., press and hold a button, or continue to swipe a finger across atouch screen or touchpad). The electronic device may drag the cursor andindicator based on the movements of the wand until the user releases theselection input (e.g., the user releases the previously held button, orceases to swipe a finger on the touch screen or touchpad). As stillanother example, the user may place cursor 1526 over a particularsection of scroll bar 1520 and provide a selection input. In response toreceiving the selection instruction, the electronic device may directindicator 1524 to jump to the location of cursor 1526 when the selectioninput was received.

The electronic device may indicate the movement of indicator 1624 usingany suitable approach. For example, the electronic device may update theportion of media 1610 displayed in display 1600 to reflect the currentposition of indicator 1624 as it is displaced (e.g., as a fast-forwardor rewind media display that may or may not include audio). As anotherexample, the electronic device may display trail 1628 associated withcursor 1626 that indicates the prior position of the cursor. In someembodiments, trail 1628 may include some or all of the features of trail304 (FIG. 3) described above. By allowing the user to place indicator1524 on any portion of scroll bar 1520, and by allowing the user to dragindicator 1524 along scroll bar 1520 at any suitable speed (e.g., at thespeed at which cursor 1526 moves), the user may control the playback ofmedia 1510 without the use of fast forward, rewind, next chapter, andlast chapter keys.

The electronic device may display any suitable indicator 1524 (and1624). In some embodiments, the indicator may include video region 1525in which a video frame or image of the displayed media (e.g., media1510) may be displayed. For example, indicator 1524 may include areduced size video region for previewing media when the user changes theplayback position. The images displayed in video region 1525 mayrepresent the current position of indicator 1524 along scroll bar 1520,and may change as the user moves indicator 1524 to provide a preview ofthe media to the user. In some embodiments, while the user movesindicator 1524, media 1510 may not change in display 1500 or may behidden from view (e.g., a blank screen) until the user stops movingindicator 1524. Once indicator 1524 stops moving, the electronic devicemay display the corresponding image of video region 1525 in display1500. In some embodiments, the electronic device may initially displaythe image of video region 1525 (e.g., a scaled up low-resolution image),and subsequently identify and display the corresponding full-resolutionimage of media 1510.

The electronic device may generate the images to display in video region1525 using any suitable approach. In some embodiments, the electronicdevice may generate the images for display in video region 1525 inreal-time as the user moves indicator 1524. For example, the electronicdevice may detect the current position of indicator 1524, identify theportion of media 1510 associated with the current position of indicator1524, reduce the size of the portion of media 1510, and display thereduced size portion of the media in video region 1525. In someembodiments, the electronic device may instead prepare the images fordisplay in video region 1525 before beginning playback. In response to auser request to scroll indicator 1524 and video region 1525, theelectronic device may display the previously prepared images in videoregion 1525 (e.g., retrieve a particular previously prepared image basedon the position of the indicator). For example, the electronic devicemay select the images to display from media 1510 prior to startingplayback of the media (e.g., after the user selects the media) or whilethe electronic device begins to play back the media (e.g., during thefirst 30 seconds of playback).

The electronic device may store the images to display in video region1525 using any suitable approach, including for example as a video,sequence of images, images associated with several video frames ofmedia, or any other suitable approach. The stored images (or videoframes) may be associated with particular portions of scroll bar 1520 orwith particular positions of indicator 1524 using any suitable approach,including for example associating images with a playback time range(e.g., from 30 minutes, 10 seconds to 30 minutes, 35 seconds), aparticular section of the displayed scroll bar (e.g., define severalsections of the scroll bar, where a particular image is displayed whenthe indicator moved to the section of the scroll bar), media frames ofthe media (e.g., one image associated with several media frames), or anyothers suitable approach.

The electronic device may select any suitable subset of media 1510 fordisplay in video region 1525. In some embodiments, the electronic devicemay select any suitable number of video frames of the media at differentintervals for display in video region 1525. For example, the electronicdevice may select 1% of the video frames of the media at regular or nearregular intervals of the media (e.g., if the media is 99 minutes long,select 100 video frames at each minute mark). When the user movesindicator 1524 across scroll bar 1520, the electronic device mayidentify the extracted video frame or image that is closest to thecurrent position of indicator 1524 for display in video region 1525. Forexample, the electronic device may identify the video frame associatedwith the current playback position value (e.g., the video frameassociated with the minute/second value of the playback position), ormay use any of the approaches described above for associating a videoframe or an image with a indicator position.

FIG. 17 is a flowchart of an illustrative process for changing theplayback position of media in accordance with one embodiment of theinvention. Process 1700 may begin at step 1702. At step 1704, theelectronic device may play back media. For example, the electronicdevice may play back a video by displaying the video in the display andproviding the audio output associated with the video to the user usingan audio output component. The played back media may include anysuitable media, including for example media selected by the user (e.g.,using a media playback application), media from the screen saverapplication, or any other suitable media. At step 1706, the electronicdevice may determine whether an instruction to control the playbackposition were received. For example, the electronic device may determinewhether an input associated with controlling the playback position wasreceived from a wand associated with the electronic device. The receivedinput may include any suitable received input, such as for example auser input on an input mechanism of the wand, or a particular movementof the wand (e.g., the wand tracing a particular pattern) associatedwith controlling the playback position of the media (e.g., play/pause,fast-forward or rewind). If the electronic device determines that noinstruction to control the playback position was received, process 1700may return to step 1706 and continue to monitor the inputs received bythe electronic device.

If, at step 1706, the electronic device instead determines that aninstruction to control the current playback position was received,process 1700 may move to step 1708. At step 1708, the electronic devicemay display a scroll bar (e.g., representing the entire length of themedia) with a playback position indicator. For example, the electronicdevice may overlay the scroll bar on the played back media (which may ormay not be paused or stopped). The user may change the playback positionof the media using any suitable approach. In some embodiments, the usermay provide an input to change the position on the scroll bar of theplayback position indicator. At step 1710, the electronic device maydetermine whether the displayed indicator was selected. For example, theelectronic device may determine whether the user placed a cursor overthe indicator. As another example, the electronic device may determinewhether the user placed a cursor over the indicator and provided aselection input (e.g., pressed and released a button on the wand, orpressed and held a button on the wand). If the electronic devicedetermines that the displayed indicator was not selected, process 1700may move to step 1712. At step 1712, the electronic device may hide thescroll bar. For example, the electronic device may remove the scroll baroverlaid on the media. If the media was stopped or paused, theelectronic device may automatically elect to resume playback of themedia (for example, from the playback position when the instruction tocontrol the playback position was received). Process 1700 may then endat step 1714.

If, at step 1710, the electronic device instead determines that thedisplayed indicator was selected, process 1700 may move to step 1716. Atstep 1716, the electronic device may determine whether cursor motion wasdetected. For example, the electronic device may determine whether anoutput from a motion detection component of the wand was received. Asanother example, the electronic device may determine whether an input onan input mechanism of the wand was provided (e.g., a z-direction input).If the electronic device determines that no cursor motion was detected,process 1700 may move to step 1718. At step 1718, the electronic devicemay display the media in full screen at the selected indicator position.For example, the electronic device may continue or resume playback ofthe media from the current position of the indicator in the scroll bar.Process 1700 may then return to step 1710 and determine whether aselection of the indicator was received.

If, at step 1716, the electronic device instead determines that cursormotion was detected, process 1700 may move to step 1720. At step 1720,the electronic device may displace the indicator to follow the detectedcursor movement. For example, the electronic device may slide ordisplace the indicator along or across the scroll bar to follow themovement of the cursor—if the cursor moves to the right, the electronicdevice may displace the indicator to the right. At step 1722, theelectronic device may identify an image to display in the indicatorbased on the current position of the indicator. For example, theelectronic device may identify a particular video frame to display in avideo region of the indicator. The electronic device may select theparticular image to display in the indicator using any suitableapproach. In some embodiments, the electronic device may extract videoframes of the media at different intervals of the media, and display thevideo frame that is closest to the portion of the media associated withthe current position of the indicator in the scroll bar. The electronicdevice may use any suitable approach to associate images or video frameswith particular indicator positions, including any of the approachesdescribed above.

At step 1724, the electronic device may display the identified image inthe indicator. For example, the electronic device may display the imageidentified at step 1722 in the video region of the indicator. Process1700 may then move back to step 1716 and continue to identify cursormovements and the associated current position of the indicator. This mayallow the image displayed in the indicator to be constantly updated,providing a preview of the media as the user fast-forwards or rewinds bydragging the indicator.

The above described embodiments of the present invention are presentedfor purposes of illustration and not of limitation, and the presentinvention is limited only by the claims which follow.

1. A method for controlling the playback of media in an electronicdevice, comprising: receiving a user input requesting playback controlthe playback of the media; displaying a scroll bar comprising: a bar;and an indicator on the bar that represents how much of the media isremaining to be played; extracting a frame of media from a position thatroughly corresponds to the location of the indicator on the bar; andshowing the extracted frame on the indicator.
 2. The method of claim 1,further comprising: moving the indicator on the bar to a new location;and changing the extracted video frame shown on the indicator to reflectthe new location of the indicator.
 3. The method of claim 2, wherein:receiving further comprises receiving a user input from an inputmechanism of a wand coupled to the electronic device; and moving furthercomprises moving the indicator in response to receiving an output from amotion detection component embedded in the wand.
 4. The method of claim3, wherein the motion detection component comprises at least one of anacceleration sensor and a gyro-sensor.
 5. The method of claim 2, whereinmoving further comprises: receiving a user selection of the indicatorusing a cursor; and displacing the cursor along the displayed bar. 6.The method of claim 5, wherein displacing further comprises: receivingan output from a motion detection component of a wand coupled to theelectronic device; and displacing the cursor based on the receivedoutput.
 7. The method of claim 6, wherein the motion detection componentis operative to provide outputs in response to detecting a motion of thewand.
 8. The method of claim 1, further comprising: wherein receivingfurther comprises receiving a user input to drag the indicator acrossthe bar; displacing the indicator in successive positions on the bar,wherein the indicator appears to be dragged across the bar; whereinextracting further comprises extracting a plurality of frames of mediafrom positions that correspond to the successive locations of theindicator on the bar; and wherein showing further comprises showing theplurality of extracted frames.
 9. The method of claim 8, furthercomprising: receiving a user request to play back the media; identifyingthe current position of the indicator on the scroll bar; and playingback the media from the identified current position of the indicator.10. The method of claim 9, further comprising pausing the playback ofthe displayed media in response to receiving the user input to drag theindicator.
 11. The method of claim 9, wherein playing back the mediafurther comprises hiding the scroll bar.
 12. An electronic device forplaying back media, the electronic device coupled to a wand comprisingan input mechanism and a motion detection component, the electronicdevice comprising a processor operative to: provide an output signalrepresenting a scroll bar comprising: a bar representing the media toplay back; and an indicator representing the playback position of themedia on the bar; and provide an output signal representing a videoframe associated with the position of the indicator on the bar in avideo region of the indicator.
 13. The electronic device of claim 12,wherein the processor is further operative to: receive an input from theinput mechanism of the wand; and pause the playback of the media inresponse to receiving the input from the input mechanism of the wand.14. The electronic device of claim 12, wherein the processor is furtheroperative to: receive an instruction to drag the indicator across thescroll bar; provide an output signal displacing the indicator on thescroll bar; and provide an output signal representing, in the videoregion, a plurality of video frames associated with successive positionsof the indicator.
 15. The electronic device of claim 14, wherein theprocessor is further operative to: process an output from the motiondetection component; and determine the amount and speed at which todisplace the indicator in response to processing the output.
 16. Theelectronic device of claim 14, wherein the processor is furtheroperative to extract the video frames to display in the video region.17. The electronic device of claim 12, wherein the input mechanismcomprises at least one of a button, a wheel, a touch screen, and atouchpad.
 18. A wand for use for controlling the playback of mediaplayed back using an electronic device, the wand operative to: receive,using an input mechanism, a first input directing the electronic deviceto overlay a scroll bar comprising an indicator over media; receive,using the input mechanism, a second input directing the electronicdevice to select the indicator; detect, from the output of a motiondetection component, motion of the wand for moving the indicator to anew position, wherein a frame of media associated with the currentposition of the indicator is displayed in a video region of theindicator as the indicator moves; and receive, using the inputmechanism, a third input directing the electronic device to resumeplayback of the media from the new position of the indicator.
 19. Thewand of claim 18, wherein the input mechanism comprises at least one ofa button, a wheel, a touch screen and a touchpad.
 20. The wand of claim18, wherein the motion detection component comprises at least one of anacceleration sensor and a gyro-sensor.
 21. A method for identifyingvideo frames for display in an indicator on a scroll bar in anelectronic device, the method comprising: determining media for displayby the electronic device; extracting a subset of frames of the media;identifying a plurality of positions of the indicator on the scroll bar,each position identifying how much of the media remains to be played;and associating each of the identified plurality of positions with atleast one of the extracted subset of frames of the media.
 22. The methodof claim 21, further comprising: detecting the current position of theindicator from the plurality of positions; retrieving the frame of mediaassociated with the detected position; and displaying the retrievedframe of media.
 23. The method of claim 21, wherein identifying furthercomprises identifying a plurality of timestamps for the media.
 24. Themethod of claim 21, wherein identifying further comprises: determiningthe length of the media; and determining intervals at which to extractframes of media.
 25. The method of claim 24, wherein the determinedintervals are equal intervals.